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AMENDMENTS TO THE CLAIMS 



Claims pending 

• At time of the Action: Claims 1-34. 

• After this Response: Claims 35-82. 
Canceled or Withdrawn claims: 1-34. 
Amended claims: None. 

New claims: 35-82. 

1-34. (Canceled). 

35. (New) A method comprising: 

receiving a first annotation object corresponding to a first multimedia content; 
creating a first annotation entry comprising: 

a first annotation identifier corresponding to the first annotation object; 
a first media characteristic for synchronizing the first annotation object 

with a first portion of the first multimedia content; and 
a first set of version identifiers corresponding to a plurality of versions of 
the first multimedia content; and 
storing the first annotation entry. 

36. (New) The method according to Claim 35, further comprising: 
receiving a second annotation object corresponding to the first multimedia 

content; 

creating a second annotation entry comprising: 

a second annotation identifier corresponding to the second annotation 
object; 
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a second media characteristic for synchronizing the second annotation 

object with a second portion of the first multimedia content; and 
the first set of version identifiers corresponding to the plurahty of version 
of the first streaming multimedia content; and 
storing the second annotation entry. 

37. (New) The method according to Claim 36, wherein the first annotation 
entry and the second annotation entry are stored in a first annotation collection of a 
metadata store. 

38. (New) The method according to Claim 37, further comprising: 
receiving a third annotation object corresponding to a second multimedia 

content; 

creating a third annotation entry comprising: 

a third annotation identifier corresponding to the third annotation object; 
a third media characteristic for synchronizing the third annotation object 

with a first portion of the second multimedia content; and 
a second set of version identifiers corresponding to a plurality of versions 
of the second multimedia content; and 
storing the third annotation entry. 

39. (New) The method according to Claim 38, wherein the third annotation 
entry is stored in a second annotation collection of the metadata store. 

40. (New) The method according to Claim 35, further comprising: 
receiving a second annotation object corresponding to a second multimedia 

content; 

generating a second annotation entry comprising: 

a second annotation identifier corresponding to the second annotation 
object; 
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a second media characteristic for synchronizing the second annotation 
object with a first portion of the second multimedia content; and 

a second set of version identifiers corresponding to a plurahty of version of 
the second multimedia content; and 
storing the second annotation entry. 

41 . (New) The method according to Claim 40, wherein: 

the first annotation entry is stored in a first annotation collection of a metadata 
store; and 

the second annotation entry is stored in a second annotation collection of the 
metadata store. 

42. (New) The method according to Claim 35, wherein the first annotation 
entry further comprises one or more items of information selected from a group 
consisting of an author, a creation time, a title, a related annotation identifier, an 
annotation set identifier and a user-defined property. 

43. (New) The method according to Claim 35, wherein the first media 
characteristic comprises temporal position information. 

44. (New) The method according to Claim 35, wherein the first media 
characteristic comprises a segment identifier of a segment in the first multimedia 
content. 

45. (New) The method according to Claim 35, wherein the first media 
characteristic comprises an event identifier of an event in the first multimedia content. 

46. (New) The method according to Claim 35, wherein the first media 
characteristic comprises a begin time and an end time defining the portion of the first 
multimedia content to which the annotation object is synchronized. 



LEE & Hayes, pllc 

RESPONSE TO OFFICE ACTION DATED SEPTEMBER 14, 2004 



Page 5 of 16 



ATTORNEY DOCKET NO. MS 1 -0304US 
Serial No. 09/396,984 



1 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 



47. (New) The method according to Claim 35, wherein the first muhimedia 
content comprises a streaming multimedia presentation. 

48. (New) The method according to Claim 35, wherein the multimedia 
content comprises a plurality of media objects that share a common timeline. 

49. (New) The method according to Claim 48, wherein a given one of the 
plurality of media objects comprises audio data, video data, text data, animation data 
or graphical data. 

50. (New) One or more computer-readable medium containing a plurality of 
instructions which when executed cause a system to perform acts comprising: 

receiving a new annotation object; 

determining an annotation identifier of the new annotation object; 

determining a first set of version identifiers identifying each version of a first 
multimedia content to which the annotation object corresponds; 

determining a first media characteristic that associates the new annotation 
object to a portion of a version of the first multimedia content; 

storing the annotation identifier, the first set of version identifiers and the first 
media characteristic as a first annotation entry in a metadata store; and 

storing the new annotation object in a content store. 

51. (New) The computer-readable medium according to Claim 50, wherein 
determining the first media characteristic that associates the new annotation object to 
a portion of the first multimedia content comprises: 

determining a target media characteristic that associates the new annotation 
object to a portion of a target version of the first multimedia content; and 

converting the target media characteristic to a base media characteristic. 
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52. (New) The computer-readable medium according to Claim 51, wherein 
the target media characteristic is converted to the base media characteristic as a 
function of a temporal parameter of the target version of the first multimedia content 
and a temporal parameter of a base version of the first multimedia content. 

53. (New) The computer-readable medium according to Claim 52, wherein 
the base version of the first multimedia content comprises a particular combination of 
a plurality of individual media streams. 

54. (New) The computer-readable medium according to Claim 52, wherein 
the base version of the first multimedia content is the originally created version of the 
multimedia content. 

55. (New) The computer-readable medium according to Claim 52, wherein 
the target version of the first multimedia content comprises a given combination of a 
plurality of individual media streams that creation of the new annotation object is 
based upon. 

56. (New) The computer-readable medium according to Claim 50, wherein 
each version identifier of the first set of version identifiers is a Uniform Resource 
Locator (URL). 

57. (New) The computer-readable medium according to Claim 50, further 
comprising: 

determining a second set of version identifiers identifying each version of a 
second multimedia content to which the annotation object corresponds; 

determining a second media characteristic that associates the new annotation 
object to a portion of a version of the second multimedia content; and 

storing the annotation identifier, the second set of version identifiers and the 
second media characteristic as a second annotation entry in the metadata store. 
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58. (New) The computer-readable medium according to Claim 50, further 
comprising: 

determining a version identifier of a second multimedia content being 
presented to a user; 

identifying each of a plurality of annotation entries in the metadata store that 
contain the received version identifier; 

retrieving each of a plurality of annotation objects respectively corresponding 
to each of the identified plurality of annotation entries from the content store; and 

rendering the plurality of annotation objects concurrently with the second 
multimedia content, wherein each of the plurality of annotation objects is presented 
proximate a respective media characteristic identified in the corresponding one of the 
identified plurality of annotation entries. 

59. (New) The computer-readable medium according to Claim 58, wherein 
the first annotation entry further includes one or more determined items of 
information selected from a group consisting of an author, a creation time, a title, a 
related annotation identifier, an annotation set identifier and a user-defined property. 

60. (New) The computer-readable medium according to Claim 59, further 
comprising ordering the rendering of a set of the plurality of annotation objects as a 
function of the related annotation identifier contained in each of the identified 
plurality of annotation entries that contain substantially the same media characteristic 
identifier. 

61. (New) The computer-readable medium according to Claim 59, further 
comprising grouping the rendering of a set of the plurality of annotation objects as a 
function of the annotation set identifier contained in each of the identified plurality of 
annotation entries. 
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62. (New) The computer-readable medium according to Claim 59, further 
comprising selectively rendering the plurality of annotation objects as a function of 
the creation time contained in each of the identified plurality of annotation entries. 

63. (New) One or more computer-readable medium containing a plurality of 
instmctions which when executed cause a system to perform acts comprising: 

receiving an indication of a Real-time Transport Protocol (RTP) address of a 
current multimedia content being presented to a user; 

identifying one of a plurality of annotation collections having an RTP address 
corresponding to the received RTP address; 

identifying each of a plurality of annotation entries of the one of the plurality 
of annotation collections; 

determining a current media characteristic of the current multimedia content; 

converting the current media characteristic of the current multimedia content 
to a base media characteristic; and 

rendering each of a plurality of annotation objects corresponding to an 
annotation identifier contained in each of the identified plurality of annotation entries, 
wherein each annotation object is rendered concurrently with the current multimedia 
content proximate the respective base media characteristic identified in the respective 
one of the plurality of annotation entries. 

64. (New) The computer-readable medium according to Claim 63, further 
comprising: 

receiving a first annotation object corresponding to a first multimedia content; 
creating a first annotation entry comprising: 

a first annotation identifier corresponding to the first annotation object; 
a first media characteristic for synchronizing the first annotation object 

with a first portion of the first multimedia content; and 
a first set of version identifiers corresponding to a plurality of versions of 
the first multimedia content; 
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Storing the first annotation entry; and 
storing the first annotation object. 

65. (New) The computer-readable medium according to Claim 64, further 
comprising: 

receiving a second annotation object corresponding to the first multimedia 
content; 

creating a second annotation entry comprising: 

a second annotation identifier corresponding to the second annotation 
object; 

a second media characteristic for synchronizing the second annotation 

object with a second portion of the first multimedia content; and 
the first set of version identifiers corresponding to the plurality of version 
of the first streaming multimedia content; 
storing the second annotation entry; and 
storing the second annotation object. 

66. (New) The computer-readable medium according to Claim 65, wherein 
the first annotation entry and the second annotation entry are stored in a first 
annotation collection. 

67. (New) The computer-readable medium according to Claim 66, further 
comprising: 

receiving a third annotation object corresponding to a second multimedia 
content; 

creating a third annotation entry comprising: 

a third annotation identifier corresponding to the third annotation object; 
a third media characteristic for synchronizing the third annotation object 
with a first portion of the second multimedia content; and 
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a second set of version identifiers corresponding to a plurality of versions 
of the second multimedia content; 
storing the third annotation entry; and 
storing the third annotation object. 

68. (New) The computer-readable medium according to Claim 67, wherein 
the third annotation entry is stored in a second annotation collection. 

69. (New) The computer-readable medium according to Claim 64, further 
comprising: 

receiving a second annotation object corresponding to a second multimedia 
content; 

generating a second annotation entry comprising: 

a second annotation identifier corresponding to the second annotation 
object; 

a second media characteristic for synchronizing the second annotation 

object with a first portion of the second multimedia content; and 
a second set of version identifiers corresponding to a plurality of version of 
the second multimedia content; 
storing the second annotation entry; and 
storing the second annotation object. 

70. (New) The computer-readable medium according to Claim 69, wherein: 
the first annotation entry is stored in a first annotation collection; and 

the second annotation entry is stored in a second annotation collection. 

71. (New) A system comprising: 
an annotation database to: 

maintain a plurality of annotation objects; and 
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maintain a plurality of annotation entries, wherein each annotation entry 
corresponds to an annotation object and includes (1) an annotation 
identifier, (2) a media characteristic correlating the annotation object 
with a particular segment of a multimedia presentation, and (3) a 
version identifier of each of a plurality of versions of the multimedia 
presentation; and 
an annotation server, coupled to the annotation database, to: 

receive a new annotation object corresponding to a particular multimedia 
presentation; 

create a new annotation entry corresponding to the new annotation object; 
and 

store the new annotation object and the corresponding new annotation 
entry in the annotation database. 

72. (New) The system as recited in Claim 71, further comprising a browser, 
communicatively coupled to the annotation server, to author the new annotation 
object. 

73. (New) The system as recited in Claim 71, wherein the annotation server is 
configured to delete an identified annotation object and a corresponding one of the 
plurality of annotation entries. 

74. (New) The system as recited in Claim 71, wherein the annotation serve is 
configured to edit an identified annotation object and a corresponding one of the 
plurality of annotation entries. 

75. (New) The system as recited in Claim 71, wherein the annotation server is 
configured to edit one of the plurality of annotation entries corresponding to an 
identified annotation object. 
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76. (New) The system as recited in Claim 71 , wherein the annotation server is 
further configured to: 

determine provisioning of a specific version of a specific multimedia 
presentation; and 

provision a specific annotation object synchronized with a corresponding 
media characteristic of the particular multimedia presentation as a 
function of one of the plurality of annotation metadata sets 
corresponding to the specific annotation object. 

77. (New) The system as recited in Claim 76, further comprising a multimedia 
server, coupled to the annotation server, to: 

maintain a plurality of multimedia presentations; 
receive a request for the specific version of the specific multimedia 
presentation; and 

provision the specific version of the specific multimedia presentation. 

78. (New) The system as recited in Claim 77, further comprising a browser, 
communicatively coupled to the media server and the annotation server, to: 

generate the request for the specific multimedia presentation; and 
display the specific version of the specific multimedia presentation and the 
specific annotation object. 

79. (New) The system as recited in Claim 71, wherein each annotation entry 
further includes one or more fields for storing information selected from a group 
consisting of an author, a creation time, a tile, a related annotation identifier, an 
annotation set identifier and a user defined property. 

80. (New) A system comprising: 
an annotation database to: 

maintain a plurality of annotation objects; and 
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maintain a plurality of annotation entries, wherein one or more of the 

annotation entries, corresponding to an annotation object, each includes 
(1) an annotation identifier, (2) a media characteristic correlating the 
annotation object with a particular segment of a multimedia 
presentation, and (3) a version identifier of each of a plurality of 
versions of the multimedia presentation; and 
an annotation server, coupled to the annotation database, to: 

determine provisioning of a particular version of a particular multimedia 
presentation; and 

provision a particular annotation object synchronized with a corresponding 
media characteristic of the particular multimedia presentation as a 
function of one of the plurality of annotation entries corresponding to 
the particular annotation object. 

81 . (New) The system as recited in Claim 80, further comprising a multimedia 
server, coupled to the annotation server, to: 

maintain a plurality of multimedia presentations; 
receive a request for the particular version of the particular multimedia 
presentation; and 

provision the particular version of the particular multimedia presentation. 

82. (New) The system as recited in Claim 81, further comprising a browser, 
communicatively coupled to the media server and the annotation server, to: 

generate the request for the particular multimedia presentation; and 
display the particular version of the particular multimedia presentation and the 
particular annotation object. 
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